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>Attempting  to  take  a  nonadversarial  approach  to  the  dispute  of  Slack  and 
Porter  with  Jackson  over  the  predictive  validities  of  the  Scholastic 
Aptitude  Test  and  the  high  school  record,  this  report  examines  both  the 
effect  of  the  selection  process  on  these  validities  and  what  these 
validities  might  be  If  all  colleges  were  to  use  a  common  standard  of 
academic  achievement.  The  results  indicate  that  JJfr-  for  this  criterion 
the  Scholastic  Aptitude  Test  may  have  a  predictive  validity  of  .62  and  an 
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The  P red lc Cion  of  College  Achievement 
from  Che  Scholar cic  Aptitude  Test 
and  the  High  School  Record 

Modern  societlee  Invest  In  higher  education  largely  to  promote 
technolog lco-cultural  advancement  and  upward  socio-economic 
mobility.  The  controversy  over  the  use  of  aptitude  tests  in  the 
college-admissions  process  reflects  different  emphases  on  these  two 
functions  of  higher  education.  The  defenders  of  this  use  tend  more 
to  value  the  first,  the  challengers  the  second.  A  theory  of  mental 
tests  exists  (e.g.,  Lord  and  Novick,  1968),  and  within  this  theory 
the  differences  between  the  two  sides  are  arguable  in  objective 
terma.  Outside  the  theory,  however,  the  differences  consist  only 
of  rival  values.  The  public  and  publicized  portion  of  the 
controversy  has  thus  tended  '.o  be  more  adversarial  than  objective 
or  dispassionate. 

The  two  sides  collide  particularly  on  the  issue  of  merit 
versus  need  as  the  basis  of  financial  aid  for  higher  education.  Op 
this  issue,  the  socio-economic  side  has  increasingly  prevailed  in 
the  United  States.  On  the  issue  of  college  admissions,  however, 
the  two  ides  are  currently  at  a  stand-off,  though  the  momentum  is 
against  the  technologlco-cultural  side.  Exemplifying  this  tendency 
are  the  article  by  Slack  and  Porter  (1980)  and  its  reply  by  Jackson 
(1980),  which  appeared  in  the  Harvard  Educational  Review. 

The  intent  here  is  to  focus  on  one  point  at  issue  in  these  two 
articles  without  taking  the  adversarial  position  of  either.  This 
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issue,  the  relative  validities  of  the  high  school  record  (HSR)  and 
the  verbal  portion  of  the  Scholastic  Aptitude  Test  (SAT)  for  the 
prediction  of  first-year  college  achievement  (FCA) ,  is  resolvable 
in  the  context  of  mental-test  theory. 

The  Opposing  Positions 

Following  Nairn  (1980),  Slack  and  Porter  (1980)  cited  the 
difference  in  predictive  validity  of  the  SAT  and  the  HSR  as  a 
compelling  reason  to  favor  the  use  of  one  rather  than  the  other,  or 
their  combination,  to  aid  in  the  selection  of  college  applicants. 
The  representative  predictive  validities  cited  are  .37  for  the  SAT 
and  .52  for  the  HSR  (on  a  scale  of  0,  for  random  prediction,  to  1, 
for  perfect  prediction).  The  correspondingly  representative  pre¬ 
dictive  validity  of  the  most  predictive  weighted  average  of  these 
two  predictors  is  .58.  The  incremental  validity  of  the  SAT  over 
the  HSR  is  thus  only  .06.  These  data,  in  view  of  the  apparent 
tendency  of  the  SAT  to  fever  upper  over  lower  socio-economic  croups 
more  than  the  HSR  does  (Goldman  and  Uldavski,  1976),  led  Slack  and 
Porter  to  ‘indorse  the  use  cf  high  school  grades  or  other  pre¬ 
college  measures  of  achievement,  rather  than  aptitude,  to  predict 
success  in  college. 

In  reply,  Jackson  (1980)  pointed  out  that  the  utility  of  a 
predictor  depends  not  only  on  its  predictive  validity  but  also  on 
the  inprovement  in  criterion  performance  expected  from  its  use  in 
selection.  According  to  Jacksou,  the  increase  from  14.6  to  18.5  in 
the  function  of  predictive  validity  that  Slack  and  Porter  used  to 
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measure  the  Incremental  utility  of  the  HSR  plus  the  SAT  over  the 
HSR  alone  amounts  to  27  percent  ([18.5  -  14.61/14.6),  not  the  mere 
4  percent  (18.5  -  14.6)  clalaed  by  Slack  and  Porter.  Becauee  the 
grading  standard  varies  from  high  school  to  high  school,  Jackson 
thus  endorsed  the  continued  use  of  the  SAT,  In  combination  with 
high  school  grades,  to  predict  college  success. 

Far  from  cbj active,  this  controversy  Is  adversarial  to  the 
point  of  manifest  distrust.  Tha  opposing  sides  center  In  the  Ralph 
Nader  and  the  Educational  Testing  Service  organizations.  The  data 
used  by  Slack  and  Porter  come  from  a  report  by  Ford  and  Campos 
(1977a)  prepared  for  the  ETS  parent  body,  the  College  Entrance 

Examination  Board.  Siding  with  Ralph  Nader,  the  publisher  of  the 

Nairn  study.  Slack  and  Porter  reworked  these  data,  evidently  in  the 

belief  that  Ford  and  Campos  had  biased  their  presentation  of  them 
to  favor  ETS.  The  .37,  .52,  and  .58  predictive  validities  pre¬ 
sented  as  representative  by  Slack  and  Porter  correspond  to  the 
over-years  median  values  of  .40,  .50,  and  .58  reported  by  Ford  and 
Campos.  Educational  Testing  Service  (1980,  Table  1)  itself  has 

preseated  what,  except  for  a  lack  of  good  faith,  might  be  generally 
acceptable  as  authoritative  median  figures:  .41  for  the  SAT,  .52 
for  the  E,  A,  and  .58  for  their  combination.  The  Incremental 
validity  of  the  SAT  over  the  HSR  based  on  these  figures  is  still 
only  .06.  Thus  by  no  means  self-serving,  these  figures  will 
provide  the  basis  of  all  subsequent  calculations  presented  in  this 
report.  A  choice  of  figures  is  necessary  even  though  in  this 
adversarial  situation  no  single  choice  might  seem  fair  to  both 
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posit iocs. 


Resolution  of  the  Dispute 

A  college-admissions  officer  reviewing  these  two  positions 
night  well  have  trouble  deciding  In  favor  of  one  or  the  other. 
Sven  If  the  lncreaental  validity  of  the  SAT  appears  to  be  less  than 
moderate,  doubts  about  the  fairness  of  varying  high  school  grading 
standards  might  compel  its  continued  use.  Counter  doubts  arising 
from  the  apparent  bias  of  the  SAT  in  favor  of  upper  over  lower 
socio-economic  groups  might,  at  the  same  time,  drive  the  admlsalone 
officer  in  the  opposite  direction.  The  vacillation  resulting  from 
the  oppoalng  forces  could  certainly  benefit  from  a  resolution 
favoring  one  side  or  the  other. 

The  resolution  cannot  depend  on  the  unreliability  of  college 
grades,  due  to  grade  Inflation,  or  the  restriction  in  range  of  SAT 
scores  and  high  school  grades,  due  to  selection,  because  chase 
conditions  affect  both  the  SAT  and  the  HSR  predictive  validities 
more  or  less  equally.  The  resolution  offered  here  depends,  rather, 
on  the  distinction  between  a  simple  correlation  and  a  part 
correlation.  A  simple  correlation  is  a  measure  of  the  tendency  of 
measurements  jn  two  variables  to  go  up  or  down  together;  a  part 
correlation  Is  a  measure  of  the  tendency  of  measure ments  cn  one 
variable  to  go  up  or  down  with  the  parte  of  measurements  on  another 
variable  that  vary  within  subpopulations  defined  by  a  third 
variable.  The  third  variable  here  is  college,  and  the  part 
measurements  are  the  observed  with  in-college  first-year  grade-point 
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average*.  Co^lementary  to  theae  are  unobserved  among-college 
measurements  of  fine-year  academic  achievement  that  do  not  vary 
fer  students  In  thn  same  college  but  that  generally  do  vary  for 
studeata  In  different  colleges  on  a  coasw)n-atandard  scale  showing 
college-co-college  grade  correspondences .  This  scale  might  show, 
for  example,  that  an  A  In  one  college  corresponds  to  a  B  In 
another.  A  student's  achievement  measurement  on  this  scale  la 
aqual  to  the  sum  of  itn  with  in-college  and  among-college  parts. 
The  predictive  validities  of  .41  for  the  SAT  and  .52  for  the  HSR 
are  not  elople  correlations  but  part  correlations— representative 
correlations  between  the  predictors  and  FCA  (first-year  college 
achievement)  measured  by  a  wlthin-college  grade-point  average.  The 
corresponding  simple  correlations  may  be— and  Indeed  estimation 
later  In  this  section  will  show  them  to  be— markedly  different. 

Dependence  of  the  Observed  Predictive  Valid it lea 

on  the  Relative  Importance  of  the  Predictors  In  Selection 

Different  from  their  slmpl J-correlation  counterparts,  the 
predictive  validities  of  the  SAT  and  the  HSR  for  the  wlthin-college 
measure  of  FCA  depend  on  the  roles  of  the  two  predictors  in  the 
selection  process.  Figure  1  illustrates  this  dependence.  The 
center  vertical  line  represents  the  scale  of  SAT  scores,  and  the  I, 
II,  III,  and  17  identify  different  colleges.  The  left  side 
describes  the  part  correlations  of  high  school  grades  (a,  b,  c,  d) 
and  SAT  scores  with  college  grades  (A,  B,  C,  D)  when  the  SAT  is  the 
sole  academic  instrument  of  selection;  the  right  side  describes  the 
same  correlations  when  high  school  grades  are  the  sole  academic 
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inatruaent  of  selection.  On  eh*  l*ft  aid*,  which  aora  accurately 
portray*  currant  practic*,  th*  relationship  h«tw*«n  high  achool  and 
coll*ga  gradaa  la  perfect—*  corresponds  to  A,  b  to  1,  c  to  C,  and 
d  to  D  in  aach  collag* — whila  tha  ralationahlp  batwaan  SAT  acoraa 
and  collag*  gradaa  la  raodo*— 350  corraaponda  aqually  to  A,  B,  C, 
and  D,  aa  dona  aach  .f  th*  othar  SAT  acoraa  ahovu;  on  th*  right 
aid*,  by  contraat,  tha  ralationahlp  baewaan  high  achool  and  collag* 
gradaa  la  random  whila  eh*  ralationahlp  batwaan  SAT  scoraa  and 
collag*  gradaa  la  parfact.  On  the  left,  th*  SAT  aorta  atudanta 

into  collag**  whara  thay  can  gat  th*  same  gradaa  that  they  got  In 
high  achool;  on  the  right,  th*  HSR  aorta  atudanta  into  collagaa 
whara  their  gradua  can  raflact  thalr  SAT  acoraa.  Bacaua*  alaoat 
avary  collag*  applicant  is  accaptabla  to  at  laaat  ona  collage, 

aalactlon  la  essentially  a  procaaa  of  aortlng  atudanta  into 

collagaa.  Th*  difference  baewaan  tha  rapraaantatlva  predictive 
validities  of  th*  SAT  (.41)  and  th*  HSR  (.52)  thua  any  largely 

raflact  th*  greater  weight  that  collagaa  have  eandad  to  place  on 
SAT  acoraa  relative  to  high  achool  grada-polnt  avaragaa  in  th* 
aalactlon  procaaa.  If  collagaa  war*  to  ravara*  eh*  waighta,  tha 
difference  would  be  correspondingly  in  eh*  oppoalta  direction. 

Satiaation  of  Predictive  Validitiaa 

for  Collage  Achiaveamnt  Measured  on  a  Coaoon  College  Scale 

Tha  predictive  validities  illustrated  in  Figure  1  are  axtrem 
cases  of  tha  within-collag*  part  correlations  of  FCA  with  th*  SAT 
(.41)  and  the  HSR  (.52).  The  corresponding  ainple  correlations 
(rgp  and  rgp)  do  not  depend  on  th*  roles  of  the  tvo 


I'lgure  1.  On  the  left,  where  SAT  scores  (350,  450,  550,  6  50) 
sort  student's  into  colleges  (1,  II,  III,  IV),  college  grades  (A,  B, 
C,  D)  correspond  with  high  school  grades  (a,  b,  c,  d)  but  not  with 
SAT  scorra;  on  the  right,  where  high  school  grades  sort  students 
into  colleges,  college  grades  correspond  with  SAT  scores  but  not 
with  high  school  grades* 
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predictors  1a  the  selection  process*  Though  unknown,  therefore, 
these  correletions  ere  iaportent  enough  to  set  lasts.  Requiring 
knowledge  of  the  sligple  correlstlona  with  college  of  the  SAT  (.62), 
FCA  (.62rSp),  end  the  HSR  (>20),  developed  In  the  Appendix  froa 
published  date  on  the  aasuaption  that  the  left  tide  of  Figure  1 
rather  accurately  describes  current  selection  practice,  this 
estlMtlon  uses  fonailes  relating  the  corresponding  pert  and  simple 
correlations  to  yield  rgp  -  .62  and  rqp  •  .35. 1  The 

predictive  validities  thus  Increase  froa  .52  to  .53  for  the  RSR  and 
froa  .41  to  .62  for  the  SAT  when  collaga-to-college  variation  In 
academic  standards  Is  taken  into  account. 

Incremental  Validity  of  the  SAT 

tor  the  Prediction  of  a  Common  College  Grade-point  Criterion 

Perhaps  the  most  telling  argument  against  the  SAT  la  that  its 
.06  incremental  validity  over  the  HSR,  reported  by  both  Slack  and 
Porter  and  ETS,  amounts  to  only  a  100(.582  .  .52^),  or  7,  per¬ 
cent  increase  in  the  predictable  variance  of  college  grades.  The 


*The  two  part-correlation  formulas  are 
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use  of  <62  and  .55,  instead  of  .41  and  .52,  to  determine  the  pre¬ 
dictive  validity  of  the  HSR-SAT  coiMnatlon  changes  this  picture 
radically,  however.  According  to  *-he  fornula  yielding  this 
validity  (.58)  from  .41  and  .52,  the  correlation  between  the  HSR 
and  the  SAT  (rgg)  is  equal  to  .32  (the  same  value  used  in  the 
Appendix  to  estimate  the  correlation  with  college  of  the  HSR). 2 
Substitution  of  .32  for  r^g  together  with  .62  for  .41  and  .55 
for  .52  in  this  formila  yields  a  correlation  of  .72  for  the  HSR-SAT 
prediction  of  first-year  college  achievement  measured  on  a  common 
grade-point  scale.  The  incremental  validity  of  the  SAT  for  this 
criterion  is  thus  .72  -  .55,  or  .17,  which  corresponds  to  an 
increase  of  100(.722  -  .55^),  or  22,  percent  in  the  predictable 
variance  of  first-year  academic  achievement  in  college.  This 
Increase  (22  percent)  means  that  the  SAT  may  have  over  three  times 
the  incremental  predictive  value  (7  percent)  previously  believed. 

The  numbers  used  in  the  foregoing  calculations  are  only 
estimates  of  imperfect  accuracy.  The  results  certainly  reverse 
the  choice,  however,  between  the  SAT  and  the  HSR  based  on  their 
relative  predictive  validities  (.62  for  the  3AT  and  .55  for  the 
HSR)  or  between  the  HSR-SAT  coni inat ion  and  the  HSR  alone  based  on 
the  incremental  validity  of  the  SAT  over  the  HSR  (.17).  On  these 
bases,  the  choice  now  is  clearly  the  SAT  or  the  HSR-SAT  combina¬ 
tion,  not  the  HSR  alone. 

2 

This  is  the  multiple-correlation  formula 

.58  /■4l2  +  -  2('4«(-52)rHS 

V 
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Cone lus ion 

Predictive  validities  of  .62  for  the  SAT  and  .55  for  the  HSR 
make  more  sense  than  the  corresponding  values  of  .41  and  .52.  High 
school  teachers  do  not  typically  assign  grades  to  predict  first- 
year  college  performance;  however.  Educational  Tenting  Service 
certainly  does  work  to  maximize  the  predictive  validity  of  the  SAT. 
Prediction  is  the  purpose  of  the  SAT,  and  the  predictive  validity 
of  .62  indicates  that  the  developers  of  the  SAT  have  achieved  this 
purpose.  The  predictive  validity  of  .72  likewise  indicates  that 
the  HSR-SAT  combination  is  a  powerful  predictor  of  first-year 
academic  achievement  in  college.  If  college-admissions  officers 
are  to  abandon  the  use  of  the  SAT  in  the  student-selection  process, 
therefore,  their  reason  oust  be  something  other  than  that  the  SAT 
might  have  a  lower  predictive  validity  than  the  HSR  or  that  the 
incremental  validity  of  the  SAT  might  be  insufficient  to  justify 
its  use.  In  reaching  this  conclusion,  however,  this  report  may 
o-ily  have  confirmed  what  college  admissions  officers  have  known 
from  experience  for  a  long  time:  The  SAT  is  nothing  if  not  valid, 
and  valid  it  is. 

If  everyone  believed  that  predictive  validity  is  as  loportant 
for  selection  as  it  is  for  the  SAT,  nothing  further  need  be  said. 
Predictive  validity  is  not  the  only  dimension  of  concern  in  selec¬ 
tion,  however.  Amid  strong  cross-currents  of  values,  college- 
admissions  officers  oust  attempt  to  avoid  not  only  bias  but  also 
the  appearance  of  bias  in  the  selection  process.  Although  bias  is 
beyond  the  scope  of  this  report,  values  are  inescapable.  Atten¬ 
dance  at  one  college  oust  have  a  greater  value  than  attendance  at 


another  college,  or  the  controversy  over  the  SAT  would  have  no 
atanlng.  Progress,  whether  of  society  or  in  society,  la  not  the 
truly  relevant  valua  of  selective  college  attendance,  however* 


Prestige  notwithstanding,  no  one  college  la  best  for  ell,  and  not 
every  college  Is  only  for  the  best*  This  report  has  thus  cone  full 
circle.  To  say  that  the  SAT  or  the  HSR-SAT  combination  la  valid  la 
to  say  that  It  can  match  students  to  colleges  well*  The  value  of 
selective  attendance  et  a  college— the  truly  relevant  value— 
depends  on  this  student-collage  match. 
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Appendix 

On  eh*  assumption  that  the  left  aide  of  Figure  1  la  a  rather 
accurate  portrayal  of  current  practice  In  selection,  this  Appendix 
uses  published  data  to  estlaate  the  correlations  with  college  of 
the  SAT  (rg(j),  FCA  (ryc)»  end  the  HSR  (r^c)  required  to 
determine  the  predictive  validities  r§p  and  rqp  from  their 
observed  part-correlation  counterparts  (.41  and  .52). 

Each  correlation  with  college  Is  an  Intra-class  correlation,  a 
ratio  to  the  population  standard  deviation  of  the  standard  devia¬ 
tion  of  college  means  for  the  variable  involved  (SAT,  HSR,  or  FCA). 
These  standard  deviations  are  known  or  directly  estimable  for  the 
SAT.  The  population  standard  deviation  for  the  SAT  has  remained 
stable  over  many  years  at  around  108  (Jackson,  1977a,  Table  1);  the 
corresponding  median  wlthln-college  standard  deviation,  determined 
to  approximate  85  from  data  published  by  Ford  and  Campos  (1977b, 
Table  4),  yields  as  an  estimate  of  the  standard  deviation  of  SAT 
college  means  ^L082  -  852,  or  67.  The  value  of  rgc  is  thus 
approximately  67/108,  or  .62. 

The  left  side  of  Figure  1  shows  that  at  each  SAT  leve;  no 
correlation  exists  between  college  and  high  school  or  college 
grades.  Insofar  as  the  SAT  predominates  in  the  selection  process, 
therefore,  within  subpopulations  of  students  having  equal  SAT 
scores  the  part-correlation  counterparts  of  the  remaining  two 
correlations  with  college  will  tend  to  be  equal  to  zero.  The 
numerators  in  the  fornulas  for  these  part  correlations  should  tend. 
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correspondingly,  Co  be  equal  to  sero:  rgc  -  rggrSC  •  0 

for  Che  HSP  and  rpg  -  rsFrSC  “  0  for  FCA.  Substitu¬ 

tion  of  the  >62  Just  eatiaated  for  r$Q  thus  yields  r^c  ■ 
.62rpg  sad  rye  “  .62rgy<.  According  to  Jackson  (1977b, 

Table  2) ,  the  value  of  rgg  over  the  years  has  averaged  around 
•  32,  and  so  rqg  -  •  62 ( •  32 ) ,  or  <20,  approximately.  No  further 
estimation  is  necessary.  Return  now  to  the  part-correlation 
formulas  for  .41  and  .52  (Footnote  1)  coapletes  the  estimation 


process 
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